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Abstract 

In this paper we present a genetic algorithm-based heuristic for non-unicost 
set covering problems. We propose several modihcations to the basic genetic 
procedures including a new Htness- based crossover operator (fusion), a vari- 
able mutation rate and a heuristic feasibility operator tailored specibcally for 
the set covering problem. The performance of our algorithm was evaluated on 
a large set of randomly generated problems. Computational results showed 
that the genetic algorithm-based heuristic is capable of producing high-quality 
solutions. 
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1 Introduction 

The set covering problem (SCP) is the problem of covering the rows of a m-row, n- 
column, zero-one matrix (a;j) by a subset of the columns at minimal cost. Defining 
Xj = 1 if column j (with cost Cj > 0) is in the solution and Xj — 0 otherwise, the 
SCP is 


Minimise 

3 = 1 



(i) 

Subject to 

V, ai i x i — k 

i — 1, . 

. . , m 

(2) 


Xj G {0,1}, 

j = L 

. . . , n 

(3) 


Equation (2) ensures that each row is covered by at least one column and equation 
(3) is the integrality constraint. If all the cost coefficients cj are equal, the problem 
is called the unicost SCP. 

The SCP has been proven to be NP-complete [19]. It has many practical ap- 
plications including crew scheduling [2, 6, 24, 28], location of emergency facilities 
[29, 31], assembly line balancing [25] and boolean expression simplification [13]. 

A number of optimal and heuristic solution algorithms have been presented in 
the literature in recent years. Fisher and Kedia [18] presented an optimal solution 
algorithm based on a dual heuristic and applied it to SCP’s with up to 200 rows 
and 2,000 columns. Beasley [12] combined a Lagrangian heuristic, feasible solution 
exclusion constraints, Gomory f-cuts and an improved branching strategy to ejl- 
hance his previous algorithm [9] and solved problems with up to 400 rows and 4,000 
columns. These optimal solution algorithms are based on tree-search procedures. 



Among the heuristic methods, Beasley [10] presented a Lagrangian heuristic 
algorithm and reported that his heuristic gave better-quality results than a number 
of other heuristics [3] [30], for problems involving up to 1,000 rows and 10,000 
columns. Recently, Jacobs and Brusco [21] developed a heuristic based on simulated 
annealing and reported considerable success on problems with up to 1,000 rows and 
10,000 columns. Sen [27] investigated the performances of a simulated annealing 
algorithm and a simple genetic algorithm on the minimal cost set covering problem, 
but few computational results were given. Earlier work, both optimal and heuristic 
solution algorithms for the SCP, can be found in [4, 5, 14, 17, 26]. 

This paper introduces a genetic algorithm-based heuristic for solving non-unicost 
SCP’s. The paper is organised as follows. In Section 2 the basic steps of a simple 
genetic algorithm are described. In Section 3 our modified genetic algorithm is 
presented. In Section 4 some parameters in the algorithm are analysed. In Section 5 
the computational results are given. Finally in Section 6, some conclusions are 
drawn. 


2 Genetic Algorithms 

A genetic algorithm (GA) can be understood as an “intelligent” probabilistic search 
algorithm which can be applied to a variety of combinatorial optimisation problems 
[22]. The theoretical foundations of GAs were originally developed by Holland [20]. 
The idea of GAs is based on the evolutionary process of biological organisms in 
nature. During the course of the evolution, natural populations evolve according to 
the principles of natural selection and “survival of the fittest” . Individuals which 
are more successful in adapting to their environment will have a better chance of 
surviving and reproducing, whilst individuals which are less fit will be eliminated. 
This means that the genes from the highly fit individuals will spread to an ip- 
creasing number of individuals in each successive generation. The combination of 
good characteristics from highly adapted ancestors may produce even more fit off- 
spring. In this way, species evolve to become more and more well adapted to their 
environment. 

A GA simulates these processes by taking an initial population of individuals 
and applying genetic operators in each reproduction. In optimisation terms, each 
individual in the population is encoded into a string or chromosome which represents 
a possible solution to a given problem. The fitness of an individual is evaluated 
with respect to a given objective function. Highly fit individuals or solutions are 
given opportunities to reproduce by exchanging pieces of their genetic information, 
in a crossover procedure, with other highly fit individuals. This produces new 
“offspring” solutions, which share some characteristics taken from both parents. 
Mutation is often applied after crossover by altering some genes in the strings. The 
offspring can either replace the whole population (generational approach) or replace 
less fit individuals (steady-state approach). This evaluation-selection-reproduction 
cycle is repeated until a satisfactory solution is found. The basic steps of a simple 
GA are shown below. A more comprehensive overview of GAs can be found in 
[7, 8, 22], 

Generate an initial population; 

Evaluate fitness of individuals in the population; 

repeat 

Select parents from the population; 

Recombine (mate) parents to produce children; 

Evaluate fitness of the children; 
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Replace some or all of the population by the children; 


until a satisfactory solution has been found; 


3 The GA-based heuristic 

We modified the basic GA described in the previous section in a way such that 
problem-specific knowledge is considered. Without loss of generality, we shall as- 
sume that the columns in the SCP are ordered in increasing order of cost and 
columns of equal cost are ordered in decreasing order of the number of rows that 
they cover. Our modified GA is as follows. 

3.1 Representation and fitness function 

The first step in designing a genetic algorithm for a particular problem is to devise 
a suitable representation scheme. The usual 0-1 binary representation is an obvious 
choice for the SCP since it represents the underlying 0-1 integer variables. We used 
a n-bit binary string as the chromosome structure where n is the number of columns 
in the SCP. A value of 1 for the i-th bit implies that column i is in the solution. 
The binary representation of an individual’s chromosome (solution) for the SCP is 
illustrated in Figure I The fitness of an individual is directly related to its objective 

column(gene) 1 2 3 4 5 n — 1 n 

bit string |l|o|l|l|o|---|l|0~| 

Figure 1: Binary representation of an individual’s chromosome 

function value. With the binary representation, the fitness /; of an individual i is 
calculated simply by 

f< = ± c M ( 4 ) 

3 - 1 

where Sij is the value of the j-th bit (column) in the string corresponding to the 
i-th individual and cj is the cost of bit (column) j. 

An important issue concerning the use of the binary representation is that when 
applying genetic operators to the binary strings, the resulting solutions are no longer 
guaranteed to be feasible. There are two ways of dealing with infeasible solutions. 

One way is to apply a penalty function to penalise the fitnesses of infeasible 
solutions without distorting the fitness landscape [23]. The other way is to design 
heuristic operators which transform infeasible solutions into feasible solutions. We 
chose the later approach of using heuristic operators because a “good” penalty 
function is often difficult to determine. 

The problem of maintaining feasibility may also be resolved by using a non- 
binary representation. One possible representation is to have the chromosome size 
equal to the number of rows in the SCP. In this representation, the location of each 
gene corresponds to a row in the SCP and the encoded value of each gene is a column 
that covers that row (see Figure 2). Since the same column may be represented in 

row(gene) 1 2 3 4 5 • • • m - 1 m 

string I 10 I 7 I 10 I 213 | 5 I • • • I 49 I 7 | 


Figure 2: Non-binary representation of an individual’s chromosome 



more than one gene location, a modified decoding method for fitness evaluation is 
used by extracting only the unique set of columns which the chromosome represents 
(i.e. repeated columns are only counted once). 

With this representation, feasibility can generally be maintained throughout the 
crossover and mutation procedures. But the evaluation of the fitness may become 
ambiguous because the same solution can be represented in different forms and 
each form may give a different fitness depending on how the string is represented. 
Limited computational experience led us to believe that the performance of the GA 
using this non-binary representation was inferior to that of the GA using the binary 
representation. 

3.2 Parent selection techniques 

Parent selection is the task of assigning reproductive opportunities to each indi- 
vidual in the population. There are a number of widely used methods including 
proportionate selection, fitness scaling and tournament selection. 

The proportionate selection method calculates the probabilities of individuals 
being selected as proportional to their fitnesses and selects individuals for mating 
based on this probability distribution. The probability of an individual i being 
selected is 


* - m 

E# 

where J, is the fitness of the i-th individual in the population and N is the population 
size. Note that since the SCP is a minimisation problem, the probability of an 
individual being selected is inversely proportional to its fitness value (i.e. a lower 
fitness means more fit). 

Fitness scaling uses the same technique except that it maps an individual’s 
raw fitness value onto a new value by subtracting a suitable value from the raw 
fitness and then uses the scaled value for the probability calculation. The reason 
for fitness scaling is that as the population converges, the range of the fitnesses 
in the population reduces. When this happens the probabilities of any individual 
in the population being selected become more or less equal. In order to favour 
selection of the relatively more fit individuals, the relative fitnesses (i.e. the ratio of 
the minimum fitness to the average fitness) can be expanded by letting 

ft =J, -rnin(/,.» = (6) 

where J, and f- denote the raw fitness and the scaled fitness respectively. 

The tournament selection method works by forming two pools of individuals, 
each consisting of T individuals drawn from the population randomly. Two indi- 
viduals with the best fitness, each taken from one of the two tournament pools, are 
chosen for mating. Using a larger value for T has the effect of increasing selection 
pressure on the more fit individuals. 

We chose the binary tournament selection (i.e. T — 2) as the method for parent 
selection because it can be implemented very efficiently (without having to calculate 
an individual’s selection probability as required by proportionate selection). Our 
study showed that the performance of binary tournament selection in terms of 
solution quality is comparable to that of proportionate selection. We also adopted 
the scaled fitness using equation (6) as the basis for fitness comparison in the fitness- 
based crossover procedure which is described below. 



3.3 Crossover operators 

In a traditional GA, simple crossover operators such as one-point or two-point 
crossover are often used. These crossover operators work by randomly generating 
one or more crossover point(s) and then swapping segments of the two parent strings 
to produce two child strings. The one-point crossover is formally defined as: 

Let Pi and P 2 be the parent strings Pi[l], . P\[n] and P 2 [l], P 2 [n] respec- 

tively. Generate a crossover point k, 1 < k < n. Then the child strings Ci and C 2 
are 


Ci := Pi [1], • • • , Pi[&], P 2 [& + 1], • • • , P 2 [n] 

C 2 := P 2 [l], . . P 2 [*], Pi[* + 1], . . . , Pi[n] 

The two-point crossover operator is similar to the one-point crossover operator 
except that it generates two crossover points instead of one. With the one-point and 
two-point crossover operators, the location of the crossover point is clearly important 
in two respects. Firstly, as the GA converges it is expected that most genes on the 
right portion of the strings Pi and P 2 will have a value of zero. This is because 
SCP solutions will consist of mostly low cost columns at this stage (remember that 
columns are ordered in increasing cost order). Therefore, if the crossover point(s) 
is(are) chosen anywhere within that region, the resulting child solutions will be 
identical to their parent solutions. Secondly, when the GA converges the solution 
structures will vary little from one to another . Hence , the ability of the one-point and 
two-point crossover operators to generate new structures from the parent structures 
may be limited. 

In order to ensure that the child is not identical to one or other of the parents we 
prefer to work with a restricted one-point crossover operator. This simply consists 
of generating a crossover point k where 

min[i, P\\i\ ± P 2 [t]] < k < max[i, % # 

The restricted two-point crossover operator can be defined in the similar way. 

Another simple crossover technique is the uniform crossover operator. The uni- 
form crossover operator works by generating a random crossover mask B (using 
Bernoulli distribution) which can be represented as a binary string: 

B: 6i6 2 t>3 • • • 6„_ i b u 

where n is the length of the chromosome. The child solution is then created by 
letting: 

C[i]:=Pi[i] if bi = 0 
V[i] P 2 [*] if bi = 1 

for fill i — l. ... . n A new crossover mask is generated for each mating. With the 
uniform crossover operator, the child string can be computed efficiently by using 
the following logical operation. 

C - (Pi AND (NOT B)) OR (P 2 AND B) 

Here we propose a generalised fitness-based crossover operator called the fusion 
operator which takes into account both the structure and the relative fitnesses of 
the parent solutions. The fusion operator produces just a single child (unlike the 
one-point and two-point crossover operators where two children are produced) and 
is as follows. 

Let /pj and /p 2 be the fitnesses of the parent strings Pi and P 2 respectively, and 
let C be the child string. Assuming a minimisation problem, then for all i — 1, . . . , n: 
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1. if l> [f = P 2 [i\ : then ( •[/; Pi[|«,P 2 [i], 

2 . if Pi [i] # P 2 [t\, then 

(a) igj»] := P 1 [*] with probability p - f P J{f Pl + fpj, 

(b) 0;p] := P 2 [i] with probability 1 — p. 

For example, if f Pl = 4, fp 2 — 6 and Pi[*] ^ t ?%\ »]. the probability that C[i\ Pi[i] 
is 6/(4 + 6 ) = 0.6 and the the probability that C[i\ := P 2 [j] is 1 — 0.6 = 0.4. 

The rationale behind this fitness-based crossover operator can be understood in 
the following way. Since the overall fitness of an individual is determined by the 
values of the genes as in equation (4), then when combining two parent strings, the 
choice of whose gene values are passed to the child should be made based on the 
relative fitnesses of the two parents. It is assumed that the inheritance of a particular 
gene from a more fit parent is likely to contribute more to the child’s overall fitness 
than that from a less fit parent. Such choices need to be made only for those genes 
with different values in both parents. Genes values which are identical in both 
parents are copied to the child. The advantage of this fitness-based fusion operator 
is that it is more capable of generating new solutions when the two parent solutions 
are similar in structure than the one-point or two-point crossover operators. This 
is because it focuses on the differences in the two combining structures. 

Note that the fusion operator can be applied in any binary-coded GA, not just 
in a GA for the SCP. The fitness values jr\ and fp 2 may also be the scaled values 
using equation ( 6 ) to bias further toward the more fit parents. 

3.4 Variable mutation rate 

Mutation is applied to each child after crossover. It works by inverting each bit in 
the solution with some small probability. Mutation is generally seen as a background 
operator which provides a small amount of random search. It also helps to guard 
against loss of valuable genetic information by reintroducing information lost due 
to premature convergence and thereby expanding the search space. 

Some GA researchers [1, 15] have suggested an optimal fixed mutation rate of 
\/n where n is the length of the chromosome. This is equivalent to mutating one 
randomly chosen bit per string. However, our study showed that this rate is too 
small for the GA to be effective. We found that a higher mutation rate is preferred 
when the GA has converged. We also found that it is beneficial to utilise a variable 
mutation rate rather than a fixed one and this variable rate should depend on the 
rate at which the GA converges. In other words, at an initial stage of the GA the 
crossover operator is mainly responsible for the search and so the mutation rate is 
set at a low value to allow minimal disruption. As the GA progresses, the crossover 
operator becomes less productive and so the mutation rate increases. When the 
GA finally converges, the mutation rate will also become stable at some constant 
rate. The rate at which the GA converges depends on the population replacement 
method. 

The relationship we developed between the convergence of the GA and the 
variable mutation rate is illustrated in Figure 3 (note that the mutation rate has 
been scaled up by a constant factor for display purposes). The convergence of the 
GA in Figure 3 is based on the steady-state replacement model. The mutation 
schedule in Figure 3 can be generalised as: 

Number of bits mutated = - ^7 — 7 (7) 

|l + exp(-4m fl (t-m c )/m / )| 

where t is the number of child solutions that have been generated, my specifies the 
final stable mutation rate, m c specifies the number of child solutions generated at 
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Figure 3: GA convergence and variable mutation rate 

which a mutation rate of my /2 is reached and m g specifies the gradient at t — m c . 
Since the number of bits mutated can only take integer values, the return value in 
equation (7) is rounded up to its nearest integer value. Note here that if m g is set 
appropriately then this function is effectively a step function at t — m c . 

The value of my is specified by the user and the values of m c and m g are 
determined based on the rate at which the GA converges for a particular problem. 
These coefficients will be discussed below in greater detail. 

3.5 Heuristic feasibility operator 

As mentioned above, the solutions generated by the fusion and mutation operators 
may violate the problem constraints (i.e. some rows may not be covered). To make 
all solutions feasible additional operators are needed. Here we propose a heuristic 
operator that not only maintains the feasibility of the solutions being generated but 
also provides an additional local optimisation step in an attempt to make the GA 
more effective. 

The steps required to make each solution feasible involve the identification of 
all uncovered rows and the addition of columns such that all rows are covered. The 
search for these missing columns is based on the ratio: 

cost of a column 

number of uncovered rows which it covers 

Once columns are added and a solution becomes feasible, a local optimisation step 
is applied to remove any redundant columns in the solution. A redundant column 
is one such that by removing it from the solution, the solution still remains feasible. 
The algorithm is as follows. 
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Let 


I — the set of all rows 
J — the set of all columns 

cm — the set of columns that cover row i, i £ / 

/3j — the set of rows covered by column j, j £ J 
S — the set of columns in a solution 
U — the set of uncovered rows 

— the number of columns that cover row i, i £ / in S 

1. Initialise w, |5 fl « } [ , Vi £ I. 

2. Initialise U \= {i \ Wi — 0 , V* £ /}. 

3. For each row i in U (in increasing order of i ): 

(a) find the first column j (in increasing order of j) in a; that minimises 

cj/\ un/3j\, 

(b) add j to S and set u, = «, + 1 V? 6 Pj Set U — U — f) 3 

4. For each column j in S (in decreasing order of j ), if Wi > 2 , Vi £ /3j, set 

S S — j and set u>i u>i — I . Vi £ . 

5. S is now a feasible solution for the SCP that contains no redundant columns. 

Step 1 and 2 identify the uncovered rows. Step 3 and 4 are “greedy” heuristics in 
the sense that in step 3, columns with low cost-ratios are being considered first and 
in step 4, columns with high costs are dropped first whenever possible. 

3.6 Population replacement model 

Once a new feasible child solution has been generated, the child will replace a 
randomly chosen member (usually one with an above-average fitness value) in the 
population. Note that an above-average fitness means less fit. This type of re- 
placement method is called incremental replacement or steady-state replacement. 
Another commonly used method is generational replacement, where a new popula- 
tion of children is generated and the whole parent population is replaced. 

The advantages of the steady-state replacement method are that the best so- 
lutions are always kept in the population and the newly generated solution is im- 
mediately available for selection and reproduction. Hence, a GA which uses the 
steady-state replacement method tends to converge faster than one which uses the 
generational replacement method. Limited computational experience showed that 
our GA using the steady-state replacement method produced better results than 
when using the generational replacement method. 

When using the steady-state replacement method, care must be taken to prevent 
a duplicate solution from entering the population. A duplicate child is one such 
that its solution structure is identical to any one of the N solution structures in 
the population. Allowing duplicate solutions to exist in the population may be 
undesirable because a population could come to consist of N identical solutions. 

3.7 Overview 

To summarise our modified GA for the SCP, the following steps are used. 

1. Generate an initial population of N random solutions. Set t 0. 

2. Select two solutions Pi and P2 from the population using binary tournament 
selection. 



3. Combine P\ and P 2 to form a new solution C using the fusion crossover 
operator. 

4. Mutate k randomly selected columns in C where k is determined by the vari- 
able mutation schedule. 

5. Make C feasible and remove redundant columns in C by applying the heuristic 
operator. 

6. If C is identical to any one of the solutions in the population, go to step 2; 
otherwise, set t t. + 1 and go to step 7. 

7. Replace a randomly chosen solution with an above-average fitness in the pop- 
ulation by C (steady-state replacement method). 

8. Repeat steps 2-7 until t — M (i.e. M non-duplicate) solutions have been 
generated. The best solution found is the one with the smallest fitness in the 
population. 

4 Parameter consideration 

Problem-dependent parameters such as the population size, the choice of the initial 
population and the variable mutation rate are considered in this section. 

4.1 Population size and initial population 

In principle, the size of the population and the initial population are chosen such 
that the solution domain associated with the population is adequately covered. 
The size of the population in turn depends on the criteria for selecting the initial 
solutions. To illustrate this point, we assume that each of the initial solutions S P 
is generated randomly using the following method (using the same notation as in 
Section 3.5). 

1. Initialise S p 0. Initialise Wi 0 , Vi £ I. 

2. For each row i in /: 

(a) randomly select a column j in a;, 

(b) add j to S P and set Wi Wi + 1, V* £ ftj . 

3. Let T Sp. 

4. Randomly select a column j, j £ T and set T —T — j. If Wi > 2, V* £ /3j , set 

S p S p — j and set Wi := u>< — £ 0j . 

5. Repeat step 4 until T — 0. 

Step 2 generates a random feasible solution. Step 4 eliminates redundant columns 
and is similar to that used in the heuristic feasibility operator except that the 
redundant columns are dropped in a random manner rather than by cost. 

Now consider a randomly generated SCP with density <f> (the density of a SCP 
is the fraction of ones in the aij matrix). The average number of columns in each 
solution S P is 1 /<f> columns. An initial population of size N will consist on average 
of N/<j) columns. In order for the initial population to cover the entire solution 
domain (i.e. having S p — J), we must have N j<j> > fin where p > 1 and is 



Problem set 

Avg. iu::,m 


JL 


~4 5 6 

”361 357 173” 

18.7 18.5 22.4 


~A 

391 

19.8 


B 

185 

24.1 


C D 

418 195 

20.8 25.1 


E F 

105 57 

29.5 31.1 


G H 

489 225 

25.0 28.4 


Table 1: Average p with respect to different problem sizes and densities 


a factor representing the average number of appearances of a column in the initial 
population. The size of the population is then 

N = p<j>n (8) 

Equation (8) shows that the required size of the population is proportional to the 
number of columns and the density of a SCP. For a large SCP, the size of the 
population may become very large. For example, if we let p = 20 to ensure adequate 
coverage, a SCP with 10,000 columns and 5% density will require a population size 
N — (20) (10,000) (0.05) = 10,000. This size is clearly too large for the GA to work 
efficiently. 

In order to make population size less dependent on problem size, we need to 
modify the initial solution selection rule above. One simple way is to generate an 
initial population that covers only part of the whole solution domain. To do this, 
we modify step 2a above to 

(2a) randomly select a column j in a;*, a;* C a;, 

where a;* is defined as the set of the k least- cost columns in a;. Since the columns 
in a; are in increasing order of cost, a;* is simply the set of the first k columns 
in ai and a;* = a; when |a;| < k. The initial population will now need to cover 
aifcUo^AU- • -U a m k which is a subset of J. In general, the value of k should be chosen 
such that there is a high probability that the set of columns in the optimal solution 
S op t is a subset of (Ji^i a ik- For the non-unicost SCP, S opt generally consists of 
columns which have low cost. In our study, we chose k — 5 for all the test problems 
we considered. 

To estimate the effect that the modified initial population selection rule above 
has on the required population size with respect to different problem sizes and densi- 
ties, we obtained some empirical data based on our test problems. Table 1 shows the 
average number of columns in the new restricted solution domain (|(J™ x a ik\) and 
the values of p with respect to different problem sizes and densities when N — 100 
and k — 5. The sizes and densities of these test problems are given in Table 2. The 
data in Table 1 shows that by modifying the initial population selection criterion, 
only a small population size (TV = 100) is necessary to provide adequate coverage 
of the initial restricted solution domain regardless of the size and density of the 
problem. 

4.2 Mutation schedule 

The variable mutation rate described in Section 3.4 involved three constant coeffi- 
cients. These were: 

• rrij , which specifies the final stable mutation rate. 

• m c , which specifies the number of child solutions ( t ) that are generated before 
the mutation schedule reaches half of the stable mutation rate. 

• m g , which specifies the gradient of the mutation function at t — m c . 
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Problem Set 

Rows (m) Colo 

Lmns (n) De, 

Number ot 
Problems 

4 

200 

1,000 

2 10 

5 

200 

2,000 

2 10 

6 

200 

1,000 

5 5 

A 

300 

3,000 

2 5 

B 

300 

3,000 

5 5 

C 

400 

4,000 

2 5 

D 

400 

4,000 

5 5 

sp 

500 

5,000 

10 5 

F 

500 

5,000 

20 5 

(i 

1,000 

10,000 

2 5 

H 

1,000 

10,000 

5 5 


Table 2: Test problem details 


As discussed in Section 3.4, the mutation operator becomes the main force for 
searching when the GA begins to converge. However, because mutation is only an 
intermediate step in the reproduction process, the bits which have been mutated 
may still be altered later by the heuristic feasibility operator. Therefore, my does 
not explicitly determine the magnitude of the search by the mutation operator as 
it would do without the presence of the heuristic feasibility operator. Our study 
indicated that the final converged solutions are generally not very sensitive to the 
values of my. Choosing a value between 5 and 10 for my is usually adequate to 
prevent the GA from being trapped in a local minimum. The values of m c and m g 
are determined according to the manner in which the GA converges. In principle, 
the mutation schedule should “match” the convergence of the GA in the manner 
shown in Figure 3. The GA convergence curve can be estimated by running the 
GA once without the mutation operator. The desirable mutation curve is then 
approximated (through visual inspection) by manipulating the mutation function 
in equation (7) using m c and m g . 

Another important parameter concerning mutation is in which set of bits (columns) 
in a string should the mutation take place such that the GA is effective. It is obvious 
that mutating high-cost columns is not as productive as mutating low-cost columns 
since the chance of high-cost columns constituting part of the optimal solution is 
rather small. Therefore, it is reasonable, as well as computationally more efficient, 
to allow the mutation to occur only in a set of “elite” bits (columns) which have a 
relatively better chance to be in the optimal solution. In our GA, we defined the 
elite column set based on the same criterion as that used for generating the initial 
population, that is: 

Selite — Q «i5 (9) 

where on$ is the set of the 5 least-cost columns in a;. 

5 Computational results 

The algorithm presented in this paper was coded in C and tested on a Silicon 
Graphics Indigo work-station (R4000, 100MHz). Our computational study was 
conducted on 11 test problem sets (a total of 65 SCP’s) of various sizes and densities. 
These test problem sets were obtained electronically from OR-library [11] (e-mail 
the message scpinfo to o.rlibrary@ic.ac.uk) . The details of these test problems are 
given in Table 2. Problem sets 4-6 and A-D are ones for which optimal solution 
values are known. Problem sets E-H are large SCP’s for which optimal solution 
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10 200 1 


10 300 1 


10 400 1 


Table 3: Mutation coefficients 


values are not known. Note here that we did not incorporate into our algorithm 
any of the problem reduction tests [9, 10] available for SCP’s. 

In our computational study, 10 trials of the GA heuristic (each with a different 
random seed) were made for each of the test problems. Each trial terminated when 
M = 100, 000 non-duplicate solutions had been generated. The population size N 
was set to 100 for all the problems and the coefficients of the mutation function (my , 
m c and m g ) for each of the problems sets are listed in Table 3. The coefficients 
in Table 3 are determined with relation to the GA convergence by using the first 
problem in each of the problem sets. Since the convergence behaviours are similar 
within each of the problem sets, we used only the first problem in each set to 
generalise the convergence behaviour for that set. Table 3 shows that the final 
mutation rate mj is set to 10 for all the problems and the coefficients m c and m g 
are set based on the GA convergence curves given in Figure 4. Since the m c ’s and 
m g ’s are relatively similar for all the problems, we made a further generalisation 
and used m c — 200 and m g — 2.0 for all the test problems. The GA convergence 
curves in Figure 4 also show that the GA generally converges very rapidly (when 
roughly 200 non-duplicate child solutions had been generated). 

The computational results are shown in Table 4. In Table 4 we give, for each 
problem: 

• the optimal solution value (problem sets 4-6 and A-D) from [12] or the pre- 
vious best- known solution value (problem sets E-H) from [21]. 

• the best solution value in each of the 10 trials, the average percentage deviation 
from the optimal solution value (problem sets 4-6 and A-D) or the average 
percentage deviation from the previous best-known solution value (problem 
sets E-H). 

• the average solution time (A.S.T.) and the average execution time (A.E.T.). 

The average percentage deviation (er) is calculated by (A/ , — S o )/10 x 100% 
where S 7 , is the i-th trial minimum (best) solution value and S a is the optimal 
solution value or the previous best-known solution value. The solution time is 
measured in CPU seconds and is the time that the GA takes to first reach the final 
best solution. The execution time is the time (CPU seconds) that the GA takes to 
generate 100,000 non-duplicate child solutions. For a comparative performance of 
different computer systems, see [16]. 

Examing Table 4, we observe that: 

1 . For problem sets 4-6 and A-D, the GA-based heuristic found optimal solutions 
in at least one of the 10 trials for all but one of the 45 test problems. The 
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Figure 4: GA convergences 


average percentage deviations from the optimal values are between zero and 
1.4%. 


For problem sets EH, the GA-based heuristic produced better (or equal) 
solutions than the previous best-known solutions in at least one of the 10 
trials for all 20 test problems. 

In 7 out of the 20 problems in problem sets E-H, the GA-based heuristic 
generated tetter solution values than the previous best-known solutions. The 
negative average percentage deviation indicates the average percentage im- 
provement from the previous best-known solution. 

The average solution times are reasonably small for all the problems (under 
800 CPU seconds). The average solution times are also much less than the 
average execution times. This suggests that the GA terminating condition 
of generating 100,000 solutions could be reduced without affecting solution 
quality. 

able 5 compares the performance of different crossover operators, namely, the 
>oint, the two-point, the uniform and the fusion crossover operators in terms 





crossover operator is computationally less expensive than the other three crossover 
operators. Note here that these results were produced using the restricted one-point 
and two-point crossover operators discussed previously. 

Table 6 shows the best solution values generated by the GA using each of the 
crossover operators over the entire set of 10 trials for each of the test problems. 
These results show that the fusion operator performs best (failing to find the op- 
timal/current best- known solution in only one of the 65 test problems). However, 
it is clear from Table 6 that the differences between the crossover operators are 
minimal. In other words our GA-based heuristic performs well irrepective of the 
choice of crossover operator. 

To measure the efficiency of the GA using each of the crossover operators, we 
recorded the redundancy rate for each of the four crossover operators as shown in 
Table 7. The redundancy rate is defined as: 

number of duplicate children lOOf 

number of duplicate children + number of non-duplicate children 

Recall here that a duplicate child is discarded in the steady-state replacement model. 
Table 7 shows that the one-point and two-point crossover operators had higher re- 
dundancy rates than the uniform and fusion crossover operators. This indicates 
that the one-point and two-point crossover operators are less successful at generat- 
ing new solution structures from the mating parents than the uniform and fusion 
crossover operators. 


6 Conclusion 

We have developed a heuristic for the non-unicost set covering problem based on 
genetic algorithms. We designed a new crossover-fusion operator, a variable mu- 
tation rate and a heuristic feasibility operator to improve the performance of our 
GA. Computational results indicated that our GA-based heuristic is able to gen- 
erate optimal solutions for small-size problems as well as to generate high-quality 
solutions for large-size problems. 





Table 7: Average redundancy rates 
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